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Dynamic Prediction of Abnormal Condition for 
Multiple Fused Magnesium Melting Processes 
Based on Video Continual Learning 


Zhang Zhe 


Abstract—Process industry is the pillar industry of national economy, particularly, the process of producing magnesia by fused 
magnesia furnace system is a typical category of process industry. Due to the complex smelting mechanism and changing production 
factors, abnormal working conditions often occur in fused magnesia furnace. The semi-molten condition is the most typical and harmful 
abnormal condition. In this paper, an adaptive pretraining-inference-dynamic training-validation semantic segmentation method based 
on industrial video is proposed for dynamic prediction of semi-molten condition of multiple fused magnesium furnaces. The 
experimental results show that compared with the prediction model without adaptive learning, the prediction performance of the 
adaptive learning model in this paper for multiple fused magnesium melting processes is significantly improved. 


Index Terms—Semantic segmentation, Video Continual Learning, Abnormal Condition Prediction, Multiple Fused Magnesia furnaces. 


1 INTRODUCTION 


P ROCESS industry is the pillar industry of national econ- 
omy. The process of producing magnesia by fused 
magnesia furnace system is a typical category of process 
industry. Due to the complex smelting mechanism and 
changing production factors, abnormal working conditions 
often occur in fused magnesia furnace, particularly, the 
semi-molten condition is the most typical and harmful 
abnormal condition. If not processed in time, it will lead 
to molten leakage, low grade magnesia products, and se- 
vere safety accidents. In this paper, an adaptive semantic 
segmentation method based on industrial video is proposed 
for dynamic prediction of semi-molten condition of multiple 
fused magnesium furnaces. 

This paper first introduces the research background of 
semi-molten condition prediction of fused magnesium fur- 
naces, and studies the research status of condition recog- 
nition and prediction, as long as adaptive deep learning 
at home and abroad. Based on the video of multi-furnace 
fused magnesium furnaces, the training dataset is carefully 
made. In this paper, an end-to-end convolutional neural 
network based on 3D U-net is designed, and an adaptive 
pretraining-inference-dynamic training-validation method 
for predicting the semi-molten condition of multi-furnace 
fused magnesium furnaces is proposed. The effectiveness of 
the proposed method is verified via industrial datasets. The 
main work of this paper is as follows: 

In this paper, the mechanism of the production pro- 
cess and semi-molten condition of the fused magnesium 
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furnaces is studied first. We point out the phenomenon of 
video feature migration between multi-furnace magnesium 
furnaces, studies the research status of abnormal condition 
recognition and prediction based on process variables or 
computer vision, as well as the research status of adaptive 
deep learning. The specific issues and main work of this 
paper are also systematically summarized. 

Aiming at the problem that it is difficult to quickly 
and effectively obtain label data for multi-furnace working 
condition video of fused magnesium furnaces, an improved 
semi-automatic labeling method for semi-molten condition 
is proposed. Firstly, the video of the smelting conditions of 
multiple furnaces of fused magnesium furnace is selected, 
and the abnormal area of each frame of the video image 
is coarsely labeled based on the spatio-temporal coordinate 
transfer method. Further, the spatio-temporal consistency 
of abnormal area labels is optimized by Weighted Median 
Filtering and Gaussian Filtering, and the data set of semi- 
molten condition prediction of fused magnesium furnace 
containing pixel-level labels of abnormal area is made. 

In view of the various interference existing in the in- 
dustrial environment, this paper proposes a 3D U-net con- 
volution neural network to train the prediction model of 
semi-molten conditions. Aiming at the problem of envi- 
ronmental light fluctuation and the inherent characteristics 
of the furnace wall, the neural network preprocesses the 
image sequences of each frame of the video through the 
time sequence consistency transformation module. 

Aiming at the problem of video feature migration in 
the multi-furnace production process of fused magnesium 
furnaces, this paper proposes a dynamic prediction method 
based on adaptive deep learning. Based on the idea of end- 
edge-cloud collaborative learning, the proposed method 
adaptively updates the cloud database by using the sample 
balance screening mechanism. The multi-prediction models 
are adaptively switched through the multi-condition trigger 
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mechanism based on validation accuracy, and the LSTM 
network is used to estimate the pixel threshold of the semi- 
molten condition prediction model, so as to realize the 
adaptive learning of the data characteristics of the new 
furnace videos by the prediction model. 

In this paper, the influence of new buffer data amount 
on the prediction results is studied through experiments, 
and the effectiveness of the proposed threshold estimation 
method of semi-molten condition prediction model based 
on LSTM network for improving the prediction accuracy in 
the presence of video feature migration is verified. Further, 
the experimental results show that compared with CRNN 
model and 2D U-net model, our adaptive dynamic learning 
model has the highest prediction accuracy and the lowest 
missing rate, for the prediction task of semi-molten con- 
ditions based on open and water mist disturbing datasets 
collected from multi-furnace fused magnesium furnaces. 


2 RELATED WORK 
2.1 


With the development of industrial artificial intelligence 
technology and industrial Internet technology, in the field of 
process industry manufacturing, data modeling, condition 
monitoring, fault diagnosis and control optimization for 
complex controlled objects based on mechanism analysis 
and process variable big data driven method have gradually 
become a research spotlight. 

Fused magnesium furnace (FMF) is a typical process 
industrial major energy consumption equipment. The pro- 
duction system of FMF melts magnesite into fused magne- 
sia by electrothermal reaction. The production factors are 
complex and changeable, and there are many interference 
factors. As an important strategic material, fused magnesia 
has the characteristics of fire resistance, high temperature 
resistance, corrosion resistance, and oxidation resistance, 
which is widely used in industries, aerospace, military and 
other fields. Semi-Molten condition is the most frequent and 
serious abnormal phenomenon in the production process of 
FMF. 

When this abnormal condition occurs, the ore cannot 
be melted in time, carbon dioxide gas produced by frame 
decomposition of magnesium carbonate will compress the 
high-temperature molten liquid to burn through the pro- 
tective layer of the furnace wall and directly contact the 
furnace wall, resulting in the burning through of the furnace 
wall and the leakage of the molten liquid, which will pose a 
threat to the safety of the inspection workers and reduce the 
grade of the fused magnesia. In this paper, an end-to-end 
adaptive pretraining-inference-dynamic training-validation 
method is used to extract the characteristics of the video 
data of the working conditions of the multi-furnace fused 
magnesium furnaces. 

Scholars have studied the diagnosis and prediction of 
semi-molten condition of fused magnesium furnace. In the 
aspect of image feature research, paper quantified the 
five characteristics of the semi-molten condition image, 
namely the flame area, the average color of the whole image, 
the average color of the flame area, the total color of the 
flame brightness area and the flame brightness. The robust 
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random configuration network was used to identify the 
semi-molten condition. 

Based the dynamic video as the main model input, 
paper |2| proposed the deep convolution to generate new 
samples from the confrontation network to make up for 
the shortage of the original sample number. In the training 
process, the smelting video was first framed, and then the 
convolution neural network [3] was used in each frame to 
realize the feature extraction of the furnace flame, the semi- 
molten furnace wall, the Mars outside the furnace and the 
background area, and then the detection and classification 
model of the image of the smelting process of the electro- 
melting magnesium furnace was established. However, this 
method did not design a targeted solution to the problem 
of environmental light fluctuation interference and high 
brightness in the smelting site of the magnesium furnace. 

Considered the dynamic information of the time and 
space dimensions of the magnesium furnace smelting video, 
paper |4] proposed the CRNN semi-molten condition diag- 
nosis method based on the deep learning of the sequen- 
tial dynamic image. This paper pointed out the difference 
between the water mist interference and the semi-molten 
condition on the time axis, introduced the super parameters 
representing the influence of the moving speed of the flame 
and the water mist on the image, and processed the gray 
consistency of the image. The sequential residual image 
was used as the input of the network to eliminate the 
environmental light and the inherent white spot of the 
furnace. CNN network and RNN network were used to 
extract temporal and spatial characteristics of the sequential 
image respectively. However, this structure separates the ex- 
traction of spatial and temporal features in video sequences, 
and does not further consider the coupling relationship 
between time and spatial dimensions. 

Paper studied the classification method of semi- 
molten conditions by selecting two process variables of com- 
plementary magnesium furnace images and current data. 
The multivariate image analysis technology was used to 
replace the human eyes, and the feature extraction of mag- 
nesium furnace flame was carried out. The semi-supervised 
learning framework based on regularization was used for 
modeling, and the cross-entropy method was used to opti- 
mize the classifier objective function. Compared with the 
traditional optimization method, the training speed was 
significantly improved. In this paper, the feature fusion 
problem of current and image is transformed into a semi- 
supervised learning problem, which reduces the work- 
load of labeling image tags compared with the supervised 
method [4], [5]. During the production and operation of 
the fused magnesium furnace system, real-time video data 
will be generated; it takes a lot of time to add labels to 
each frame of video image, which cannot predict the semi- 
molten condition of magnesium furnace in real-time online. 
Therefore, through adaptive deep learning methods such as 
transfer learning |6|, relying on a small amount of label or 
even unlabeled video information obtained in real time, it 
is of important industrial application value and promotion 
value to predict whether the semi-molten industrial mines 
of magnesium furnace occur. 

In the visible light range that can be collected by the 
video signal acquisition equipment, it is difficult for the 
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human eye to accurately detect the early semi-molten area 
with unobvious characteristics in real time under the harsh 
and complex production environment, so as to predict the 
occurrence of semi-molten condition and give early warn- 
ing. The goal is to achieve and exceed the effect of direct 
observation by the human eye. 


2.2 


U-net network is developed from FCN fully convo- 
lutional neural network [8]. The jump connection layer 
transmits high-resolution information directly from the en- 
coding path to the decoding path of the same dimension 
through data splicing operation, so as to provide more 
refined features such as gradient for image segmentation. 
At the same time, the low-resolution information on the 
coding path after multiple down-sampling is transmitted 
to the decoding path to provide the semantic information 
of the segmentation target in the whole image context. The 
information of relevant dimensions can be visualized by 
deconvolution [p]. U-net network is commonly used in high 
dynamic range image reconstruction, end-to-end semantic 
segmentation and other fields. 

Deep learning has greatly improved the accuracy of 
image segmentation. Ppaer successfully used the deep 
learning method for image segmentation for the first time. 
In this paper, the full connection network was replaced by a 
convolution network, and the small feature map was rolled 
out of a large feature layer by transposition convolution, 
which can output the segmentation map of the same size 
as the original image. DeepLab Cavity Convolution ex- 
pands the receptive field while keeping the amount of com- 
putation unchanged, and can grasp more global information 
of images when the feature map is reduced to the same 
multiple. PSPNet network is a pyramid scene parsing 
network. The network proposes a module with hierarchi- 
cal global priority and contains different scale information 
between different subregions. The context information and 
multi-scale fusion improve the segmentation accuracy. Mask 
R-CNN accomplished target detection and semantic 
segmentation simultaneously. U-net network retains a 
large number of feature channels in the expansion path, so 
that more information flows into the restored segmented 
image, and overlays the feature maps of the same size on 
the compression path and the expansion path through jump 
connections to reduce the image information lost on the 
compression path. 

Transfer learning is an important means to solve the 
basic problem of difficult access to labeled data in the field 
of machine learning. Domain adaptation is a kind of iso- 
morphic transfer learning |6], in which domain is composed 
of data features and feature distribution, and is the main 
body of learning, the source domain is a domain with 
existing knowledge and rich supervisory information, while 
the target domain is a domain to learn, generally unsuper- 
vised or less supervised information. In the study of the 
prediction of the semi-molten condition of the fused magne- 
sium furnace, the video data information of the magnesium 
furnace is generated in real time. However, the image of the 
magnesium furnace working condition obtained by frame 
by frame has no label, and the prediction network cannot 
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know whether the semi-molten condition occurs. Therefore, 
it is necessary to label the image automatically by manual 
labeling or the automatic labeling method of the working 
condition based on the weighted median filtering [4] or to 
design the classifier of the semi-molten condition based on 
the deep neural network Bl, which has certain hysteresis in 
the production prediction. 

Unsupervised domain adaptation does not require 
any label data in the target domain, but requires a large 
number of target domain data to adapt to the distribution 
of data, without any semantic information. Semi-supervised 
domain adaptation requires only a small amount of tag 
data in the target domain to achieve the performance that 
exceeds UDA [15]. In practical applications, a small amount 
of tag data can be obtained in new fields. This method is 
more suitable for practical applications. 


2.3 Dynamic continuous learning of industrial big data 


Dynamic open environment often shows the characteristics 
of distribution deviation, category increase, attribute change 
and target diversity [16]. Decision problems in dynamic 
open environment often show dynamic uncertainty (171, 
which will weaken the robustness of artificial intelligence 
technology. When deploying artificial intelligence systems 
in high-risk tasks, we should study how to improve the 
robustness of the model from the model and data levels 
[18}. In order to cope with the unknown risks in the open 
environment, we studies the feature distribution deviation 
of industrial video data caused by the change of production 
environment. 

The essence of semi-molten condition prediction of fused 
magnesium furnace is image segmentation, which realizes 
the recognition and prediction of semi-molten area of fur- 
nace wall at pixel level. Image segmentation refers to the 
technology and process of dividing an image into several 
regions with unique properties and proposing interested ob- 
jects. From a mathematical point of view, image segmenta- 
tion is the process of dividing the digital image into disjoint 
regions. Its essence is to divide each pixel into categories or 
different independent individuals, and extract a region or 
a feature of concern to exclude redundant information on 
the image, which is conducive to reducing the calculation of 
subsequent operations. 

For image processing tasks, the accuracy of deep learn- 
ing network obtained from zero-start training is not neces- 
sarily high. On the basis of the existing training model based 
on a large number of training data, the model parameters 
are modified to achieve better results. This is a pretrain—fine 
tune strategy [19], fine tuning refers to the process of acting 
the pretrain model on the target task data set and adapting 
the parameters to the target task data set. 

In this paper, the adaptive deep learning method for 
the prediction model of semi-molten condition of fused 
magnesium furnace is studied. The prediction object of the 
model can be converted from closed set to open set. Based 
on the incremental learning idea of focus loss function [20], a 
prediction model based on historical video data is obtained 
by pretraining. The parameters of convolution layer and full 
connection layer are modified according to the new video 
data by fine tuning method, and the new model parameters 
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are constrained by the loss function, so that the adaptive 
learning model is still effective for the prediction of semi- 
molten condition of historical data, and the generalization 
ability of the model is improved. 

At the same time, according to the accuracy and loss 
value of the effect of prediction models, the trigger mecha- 
nism of the model updating is designed, and the accuracy 
and loss function of the semi-molten condition of the vali- 
dation set of the incremental training model, the historical 
model and the pre-training model are compared. The opti- 
mal model is determined and saved automatically, and the 
historical prediction model is replaced, which improves the 
prediction accuracy of the semi-molten condition of the new 
buffer of video data. 


3 VIDEO DATASET BASED ON MULTIPLE FUSED 
MAGNESIA FURNACES 


The data set includes the original images and labels of each 
frame of the video. The data label reflects whether the semi- 
molten condition, the time of semi-molten condition and 
the pixel-level region appeared in each furnace video. Only 
by accurately producing the label, it is possible to train 
the model with high prediction accuracy. Therefore, before 
designing the adaptive deep learning network for the semi- 
molten condition of the fused magnesium furnace, the video 
of the operating condition of the fused magnesium furnace 
should be analyzed, and the video clips containing the semi- 
molten condition and the normal condition at the same 
time with the appropriate time length in multiple furnaces 
should be intercepted produce the data set containing the 
operating condition image and its pixel-level label. 

Among them, the working condition video is the .MTS 
format file collected by the Sony video acquisition equip- 
ment, which needs to be converted into the AVI format file. 
After that, the label is made by Matlab and saved as data 
file in MAT or .HDF5 format. The preprocessed images of 
each frame of the video are used as the network input, and 
the working condition label made by the weighted median 
filtering and other methods is used as the expected output 
of the model. Then, the three-dimensional U-net neural 
network based on temporal consistency transformation is 
trained to obtain the semi-molten working condition pre- 
diction model. 

In this paper, the MAT neural network training data sets 
are produced based on the production condition video of 
two furnaces of fused magnesium furnace. This method can 
be applied to the production of multi-furnace video dataset. 
Firstly, this paper selects three videos with proportional 
balance between semi-molten and normal conditions and 
analyzes the time and spatial distribution of semi-molten. 

In terms of the production of semi-molten area labels, we 
first use the method of spatio-temporal coordinate transfer 
to mark the semi-molten area coarsely, and then uses the 
weighted median filtering method to filter the video image 
sequence to optimize the semi-molten label of the coarse 
label, and solves the problem that the label of individual 
labels is abnormally zero due to the small semi-molten area 
by the label transfer method of adjacent frames. 

Furthermore, based on the label transfer method, the 
spatio-temporal consistency label of the semi-molten label 
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is optimized by Gaussian filtering, and the semi-molten 
area label with smooth edge and high accuracy is produced. 
The more accurate the semi-molten area label is, the more 
accurate the position of the semi-molten area predicted by 
the model is. The training of semi-molten prediction model 
in this paper provides a reliable data set. 


4 ADAPTIVE DYNAMIC PREDICTION METHOD FOR 
ABNORMAL CONDITIONS 


The smelting system of fused magnesium furnace is a 
complex practical industrial production system. At present, 
some scholars have selected process variables such as the 
working condition image of magnesium furnace (2), oy 
(21), graphite electrode current, current fluctuation rate $ 
average gray variance of melting zone, and liquid level rise 
rate of molten pool to study the working condition 
of magnesium furnace. Among them, graphite electrode 
current fluctuates frequently with the change of ore particle 
shape, composition and voltage, which has strong time- 
varying characteristics and is difficult to be inferred stably 
and accurately for a long time. Variables such as the rising 
speed of molten pool page are difficult to obtain, and the 
data amount is insufficient [24]. There are challenges in 
establishing coupling relationship between electrode current 
and image of magnesium furnace in time and space dimen- 
sions. 

In order to enhance the generalization ability of semi- 
molten condition prediction model, this paper adopts the 
idea of incremental learning. Incremental learning does not 
need to save a large number of historical video data, which 
can reduce the occupation of storage space. However, it can 
make full use of the training results based on historical data, 
which can significantly reduce the follow-up training time. 

In this paper, the strategy of pretraining-dynamic 
learning-dynamic inference-model validation is adopted. 
With the continuous updating of video data, the adap- 
tive learning of all convolution layers and all connection 
layers in the three-dimensional U-net network is realized. 
The adaptive updating strategy of training data based on 
the sample balance screening mechanism is proposed, and 
the adaptive correction strategy of multi-prediction model 
based on the trigger mechanism is designed. Furthermore, 
the threshold estimation method of semi-molten condition 
prediction model based on long-term and short-term mem- 
ory network is proposed to realize the adaptive deep learn- 
ing of semi-molten condition prediction model of multi- 
furnace magnesium furnace.Combined with the parameters 
of magnesium furnace video sequence introduced in this 
paper, the model training objective function is as follows : 


L(Yx, Yon) =- |a: Yk(1 — Pm)” log (Ying) 

+ (i= a): (1 Yk)(Ym,)” log — Youll 

1 

As for adaptive correction of the model, a validation set 
updating method based on fixed buffer updating is pro- 
posed, that is, after each new buffer data set is added, 
a validation set updating mechanism is triggered, and a 
fixed number of tuples are selected from the first tuple of 
the training set along the time dimension, which is called 
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a fixed buffer updating validation set. The Adaptive Cor- 
rection Strategy for Multiple Forecasting Models Based on 
Triggering Mechanism is shown in the following formula, 
the index L represents the value of the loss function: 


Mere LP? = mind LP", Le, Lirain} 

his rhis _ : pre Lis train 
M; Li = min{L;"", Li Ly } / (2) 
Mirain: pyran = min{ L", Le, prany 


M = 


However, the validation set determined by this method is 
too far from the new buffer data in the time dimension, 
and the data characteristics of the validation set and the 
new buffer data may be quite different. Therefore, this 
paper further proposes a buffer-by-buffer dynamic updating 
method of the validation set. 

The specific steps are as follows: After adding a new 
buffer to the training set. Starting from the last tuple of the 
training set before the new buffer, the historical data are 
traced along the time dimension to obtain the equal number 
of data source groups with semi-molten condition labels 
and normal condition labels, respectively. The validation 
set is updated buffer by buffer by splicing and sequence 
disruption. In this paper, the data of the validation set is 
enhanced to increase the number of images in the validation 
set. 


5 EXPERIMENT AND ANALYSIS 


According to experience, it usually takes about 20 to 50 
seconds to change from normal condition to semi-molten 
condition in the operation of fused magnesium furnace. 
Firstly, based on the idea of pretraining-inference-dynamic 
training-validation, adaptive learning is carried out for each 
new buffer of image sequence. After learning, the semi- 
molten condition of the next new buffer is predicted. Based 
on this idea, 300 image-label tuples with new buffer num- 
ber are selected for experimental validation. The model is 
evaluated mainly from the actual prediction accuracy of the 
model and the maximum potential of the model prediction 
accuracy. 

Furthermore, this paper expands the adaptive learning 
data set and further expands the number of tuples in each 
buffer. Multiple sets of experiments are carried out when 
the number of tuples takes different values. The prediction 
indicators, accuracy, missing rate and error rate of the 
incremental model and the pre-training model trained in 
this paper are compared under different conditions such as 
fixed test threshold, dynamic test threshold and optimal test 
threshold, respectively, which verifies the effectiveness of 
the adaptive deep learning method for fused magnesium 
furnace proposed in this paper. 

Threshold based classification is a common classification 
method. The essence of the proposed test threshold is a 
binary classification threshold, and its value range is -0.01 
to 0.99. When the semi-molten condition prediction model 
is used to predict the working condition of the new buffer 
image sequence, this paper compares the pixels of the pixel- 
level semi-molten region segmentation results correspond- 
ing to each frame image sequence predicted by the model 
(the value range is 0.00 to 1.00 ) with the test threshold. If 
the pixel value is less than the test threshold, the pixel value 
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is set to 0, this paper considers that there is no semi-molten 
condition at the pixel point, and vice versa. 

Overall, the prediction ability of the semi-molten condi- 
tion prediction model and the value of the test threshold 
determine whether the model is reasonable or not. The 
previous research predicts a large-scale data of the same 
furnace, assuming that the labels of these data were known, 
so the optimal threshold of large-scale data of the same 
furnace was taken as the test threshold. However, the key 
of this study is to predict the small buffer data of different 
furnaces in buffers. 

Combined with industrial practice, the label of the small 
buffer data of each buffer is unknown, so the test threshold 
is also unknown. Therefore, we make reasonable assump- 
tions combined with the actual production process, and 
puts forward the methods based on data law and LSTM 
long-term and short-term artificial neural network to predict 
the test threshold for small and large new buffer data. 
The experimental results show the effectiveness of the two 
methods. 

In this paper, the adaptive deep learning method for 
under-burning condition prediction of fused magnesium 
furnace is studied experimentally. The experimental results 
show that the proposed method can greatly improve the 
prediction accuracy of the new furnace video. 


Table 1 


Prediction results by various models proposed in this paper 


Forecast indicators 


Inference threshold estimator Gro_size 600 Gro_size 2400 


ACC Adaptive Data Rule or LSTM 91.23% 87.20% 
ACC _ Adaptive Historical Threshold 88.67% 76.64% 
ACC Pretrain Fixed Threshold 72.11% 71.24% 
ACC_Adaptive_Upper Previous Optimal Thre 95.44% 92.67% 
MissR_Adaptive Data Rule or LSTM 0.98% 7.66% 
MissR_Adaptive Historical Threshold 2.75% 10.68% 
MissR_Pretrain Fixed Threshold 21.46% 21.98% 
MissR_Adaptive_Upper Previous Optimal Thre 2.51% 5.38% 
ErrorR_Adaptive Data Rule or LSTM 7.79% 5.14% 
ErrorR_Adaptive Historical Threshold 8.58% 12.68% 
ErrorR_Pretrain Fixed Threshold 6.43% 6.87% 
ErrorR_Adaptive_Upper Previous Optimal Thre 2.05% 1.95% 


According to Table 1, the dynamic prediction model of 
abnormal conditions proposed in this paper can improve the 
prediction ability of semi-molten conditions of new videos 
with changed data characteristics through adaptive deep 
learning. Taking 600 image sequences-tags with new buffer 
data, i.e. group size is equal to 600, as an example, when 
the test threshold is fixed (i.e. the optimal test threshold ob- 
tained by the pretrain model for all the data of new furnaces 
), the accuracy of the pretrain model based on historical fur- 
nace video data training for the prediction of semi-molten 
conditions of new furnaces is 72.11 %, the missing rate is 
21.46 %, and the error rate is 6.43 %, while the accuracy is 
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improved to 91.23 % by the adaptive deep learning method. 
The miss rate decreased to 0.98 % and the false reporting 
rate to 7.79%. It should be noted that the error rate and miss 
rate are negatively correlated and both are related to the test 
threshold, so these two indicators should be studied as a 
whole. The experiment results verify the effectiveness of the 
proposed adaptive deep learning method for semi-molten 
conditions based on dynamic threshold. 

At the same time, it is found that if the new buffer data 
is small, the adaptive learning time and calculation amount 
will be doubled. There may also be a phenomenon that 
the change of data characteristics is small, resulting in that 
the adaptive learning advantage is not obvious, and this 
phenomenon deviates from the key content of this paper. 

The results of the prediction model and the pre-training 
model are compared and analyzed when the new buffer 
data is taken into different values. It is verified that com- 
pared with the pre-training model, the adaptive deep learn- 
ing method in this paper can greatly improve the accuracy 
of prediction and reduce the missing rate and error rate. 

Since the prediction of semi-molten condition is essen- 
tially a two-classification problem, the prediction results are 
related to the test threshold. Therefore, under the premise of 
ensuring the accuracy of prediction meets the requirements, 
this paper proposes two methods to predict the semi-molten 
ratio of new buffer data based on data law and LSTM 
respectively, and determines the test threshold based on the 
relationship between the semi-molten ratio and the optimal 
test threshold. 


Table 2 
Prediction results of abnormal conditions compared with other models 


Model ACC MissR ErrorR 
CRNN 72.38% 21.32% 6.30% 
U-net 86.00% 10.48% 3.52% 
Proposed 91.23% 0.98% 7.79% 


As shown in Table 2, compared with the CRNN pre- 
diction model and the 2D U-net prediction model, the 
adaptive learning prediction model in this paper has the 
highest prediction accuracy, which verifies that the adaptive 
deep learning method in this paper can effectively learn 
the characteristics of new data. Moreover, the missing rate 
of the model in this paper is the lowest, which verifies 
that the adaptive learning method can accurately predict 
semi-molten conditions, and has good prediction ability for 
semi-molten conditions with small area, low brightness and 
difficult to identify by human eyes. In addition, we note that 
the proposed model may predict some normal conditions as 
semi-molten conditions. Since the purpose of this study is 
to predict all semi-molten conditions as far as possible, it 
is acceptable that the missing rate is too high in a certain 
range, which may be due to inaccurate labels or the model 
can find semi-molten characteristics that are difficult to 
observe by the naked eye. According to the experimental 
results, compared with the CRNN prediction model and 
the two-dimensional U-net prediction model, the adaptive 
deep learning method proposed in this paper has stronger 
prediction ability. 


6 CONCLUSION 


In this paper, an adaptive deep learning method for multi- 
furnace semi-molten conditions is proposed to solve the 
problem that the video data characteristics of multi-furnace 
semi-molten conditions change. The experimental results 
show that compared with the prediction model without 
adaptive learning, the prediction accuracy of the adaptive 
learning model in this paper for the new furnace semi- 
molten conditions is significantly improved, and the pre- 
diction missing rate and error rate are significantly reduced. 
Moreover, the adaptive learning model has high prediction 
ability for small areas and low brightness semi-molten con- 
ditions that are difficult to be found by human eyes. 


Firstly, this paper investigates the research background 
of semi-molten condition prediction of fused magnesium 
furnace with major energy consumption equipment, and 
introduces the research status of condition identification and 
prediction at home and abroad as well as the research status 
of adaptive deep learning. 


Secondly, we selects the video data of the multi-furnace 
semi-molten condition of the fused magnesium furnace. 
In addition, we implement the acquisition and coordinate 
calibration of the multi-furnace semi-molten area. The labels 
are optimized by weighted median filtering and Gaussian 
filtering, which provides a data set containing pixel-level 
labels of the semi-molten area for model training. 


Furthermore, a three-dimensional U-net convolutional 
neural network containing temporal consistency transfor- 
mation module is constructed. Through the incremental 
learning of other furnace video data by pretraining model 
and the adaptive updating mechanism of model based 
on trigger mechanism, an adaptive deep learning method 
for semi-molten condition of fused magnesium furnace is 
proposed. Based on this method, experimental research is 
carried out, and the test threshold of new buffer video data 
is predicted based on data law and LSTM long-term and 
short-term memory network. 


In this paper, a variety of prediction models are designed 
and continuously improved. An adaptive deep learning 
model based on three-dimensional U-net convolutional neu- 
ral network and a test threshold prediction method based 
on mathematical laws and LSTM long-term and short- 
term memory network are obtained. In this paper, adap- 
tive model and test threshold prediction method are called 
adaptive prediction method. 


Further, the experimental results show that compared 
with CRNN model and two-dimensional U-net convolution 
model, the adaptive deep learning model trained in this 
paper has the highest prediction accuracy and the lowest 
missing rate. The above experimental results prove the ef- 
fectiveness of the proposed adaptive deep learning method. 


In terms of the future work prospect, this paper proposes 
the end cloud collaborative reasoning framework corre- 
sponding to the adaptive learning method. In the future, the 
problem of weak supervision training of the model can be 
solved by the weak supervision domain adaptive method in 
the case of the real-time acquisition of the working condition 
data of the fused magnesium furnace without labels. 
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